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Field of the Invention 

The present invention is in the field of data packet processing and 
pertains particularly to methods and apparatus for predicting 
characteristics of packets arriving at a processor for processing for the 
purpose of reducing overall latency related to packet processing. 

Background of the Invention 

In data packet networks, of which the well-known Internet is a 
prime example, information is prepared and sent in the form of separate 
data packets over a data packet network from source to destination. 
Such a network comprises an elaborate interconnection of nodes, and 
data packets may take various paths from source to destination, 
accomplishing a number of separate hops along a particular network 
path. At each computerized node, packets are processed and forwarded 
on to a next node or to a final destination. 

Each node that is a router in a data packet network comprises 
processors that receive incoming data packets and processes them 
according to forwarding information before sending them on. In current 
art, as one might expect, processors operate only on received data 
packets. 

It has occurred to the inventor that if certain characteristics of 
soon-to-arrive data packets can be predicted before these packets 
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actually arrive to a packet processor, then latency in normal packet 
processing may be reduced. Reduction could be in proportion to 
successful prediction of packet characteristics. 

What is clearly needed is a method and apparatus for enabling a 
5 processor to predict certain characteristics of incoming data packets 

before they actually arrive for processing. A system such as this would 
reduce overall latency in the art of packet processing. 

10 Summary of the Invention 



In a preferred embodiment of the present invention a system for 
W processing data packets in a data packet network is provided, comprising 

M at least one input port for receiving data packets, at least one output port 

W 

IjI 1 5 for sending out data packets, a processor for processing packet data, and 

a packet predictor for predicting a future packet based on a received 
p packet, such that at least some processing for the predicted packet may 

gj be accomplished before the predicted packet actually arrives at the 

system. 

i 

111 20 In some embodiments the data packet network is the Internet 

JS network. Also in some embodiments the packet predictor mechanism 

utilizes a history record periodically updated by the system, to generate 
predicted data. The history record may comprise characteristics of 
recently received data packets, and may further comprise results of past 
25 predictions. In some embodiments packet prediction comprises 

predicting specific characteristics, comprising one or more of packet 
type, packet flow identification, sender information, destination 
information, and packet size. 

The system in embodiments of the invention may be implemented 
30 in data routers and data servers. 

In another aspect of the invention a packet predictor for 
enhancing a data packet processor is provided, comprising an input for 
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receiving information about a first packet received for processing, a 
predictor for predicting characteristics of a packet to arrive at a later 
time, based upon the information received about the first packet, and an 
output for providing the predicted characteristics to the processor for 
5 processing ahead of arrival of a real packet fulfilling the prediction. 

In some embodiments the data packet processor comprises a data 
router operating on the Internet network. Further the packet predictor 
may comprise a history record consulted each time a prediction is made. 
The history record may comprise history of real packets received and 
1 0 processed. Further the history may comprise history of predictions and 
result of the predictions. This history record may be stored in a memory 
accessible to the mechanism. 
^ In some preferred embodiments packet prediction comprises 

4l predicting specific characteristics, comprising one or more of packet 

iff 1 ^ tyP e > packet flow identification, sender information, destination 
% information, and packet size, and the predictor has application in data 

§1 servers as well as routers. 

gj In yet another aspect of the invention a method for reducing 

It latency in packet processing for a packet processor, comprising the steps 

HI 20 of (a) speculatively predicting characteristics of packets yet to arrive for 
processing, based on packets actually received for processing; and (b) 
accomplishing speculative processing on the predicted characteristics. 
This packet processor may be coupled with a data packet network, which 
may be the Internet network. 
25 In some preferred embodiments of the method there is a step for 

maintaining a history of either or both of packets actually received and 
results of prior predictions. The history for received packets may 
comprise one or more of packet type, packet flow identification, sender 
information, destination information, and packet size. 
30 In some cases, in step (b) the speculative processing is abandoned 

if it is determined not to agree with the real data once it arrives. Also in 
some cases speculative processing is accomplished only on selected 
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predicted characteristics of the predicted data packet. If some of the 
results from processing the predicted characteristics are wrong they may 
be abandoned, and results which are correct may be retained, to reduce 
processing for an arriving packet based on the prediction. 
5 In embodiments of the present invention described in enabling 

detail below, for the first time it becomes possible to enhance the 
function of data packet routers by anticipating characteristics of packets 
yet to arrive, and speculatively accomplishing some or all of the 
processing requirements for an anticipated packet before the packet 
10 actually arrives to be processed. 
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% Brief Description of the Drawing Figures 

Iff 15 Fig. 1 is block-diagram illustrating components of a typical 

pi 

network processor according to prior-art. 

Fig. 2 is a block-diagram illustrating components added to a 
Q network processor to enable packet prediction according to an 

S embodiment of the present invention. 

f|l 20 Fig 3 is a block-diagram illustrating a data packet prediction 

14 mechanism of Fig. 2. 

Fig 4 is a block-diagram illustrating reduced processor latency by 

successful packet prediction according to an embodiment of the present 

invention. 

25 Fig. 5 is a process flow diagram illustrating system steps for 

practicing the invention. 



Description of the Preferred Embodiments 

30 

As described in the background section of this specification, 
current art packet processors, operating typically in data routers, operate 



only on packets received to be routed. The inventor, according to an 
embodiment of the present invention, provides an apparatus and method 
that enables a processor to predict characteristics of a next incoming data 
packet and initiate speculative processing before the actual next packet 
arrives for processing. The method and apparatus of the present 
invention is described in enabling detail below. 

Fig. 1 is block-diagram illustrating components of a typical 
network processing system according to prior-art. A packet buffer or 
queuing system 101 is illustrated in this example of prior art as a typical 
system present in data packet processors. Packet buffering system 101 
comprises a direction logic block 102 adapted for receiving data packets 
at ingress and determining which of a plurality of data queues will be 
selected for holding the packet data prior to processing. In this example, 
there are a plurality of logically-illustrated queues 104a, 104b to 104n. It 
will be appreciated by one with skill in the art of data processors that 
there typically may be more than three queues associated with a data 
packet processor used for data routing on a data network. 

In this example, an incoming data packet labeled Packet Info has 
been entered in queue 104n as indicated by cross-hatching. The data 
actually stored in such a queue can include simply packet identifiers and a 
packet header to be processed, or a complete and full data packet. This 
option is largely design dependant. The set of queues 104 a-n has an 
associated buffer control logic 103 that is connected by control path to a 
common access path or line shared by each queue. The method of 
control and communication between buffer logic 103 and queue set 
104a-n is only logically represented in this example. Actual physical links 
and structures may vary according to design. It will be appreciated by 
the skilled artisan that multiple ingress ports may share one set of data 
queues 104a-104n and that it is assumed that data packets are serially 
enqueued and dequeued. 

A selection logic 105 is illustrated within packet buffer system 
101 and is adapted to manage how processed packets are selected to be 
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sent out of queue to egress of the processing system after processing is 
complete. Dequeue logic 105 is illustrated as connected by control path 
to a common access line shared by all of the queues in set 104a-n as was 
described above with reference to direction logic 103. A processing core 
5 106 is illustrated in this embodiment and is adapted to process data 
packet information while data packets are in the system. Core 106 is 
logically connected through selection logic 105 to queue set 104a-n by a 
control line. 

In typical prior-art processing, packets arrive through ingress of 
1 0 the system as illustrated herein by the label Packets In, and are buffered 
in any one of queues comprising set 104a-n according to direction logic 
_ 102. At least a packet identifier including a queue address location 

yj identifier labeled herein simply Packet ID is made available to processing 

y core 106. Core 106 processes the packet information according to 

^ 1 5 applicable software. It is noted in this prior-art example that processing 
;4S by core 106 cannot begin until an actual data packets or sufficient 

m 

g information of one is enqueued in one of queues 1 04a-n and is identified 

Jgj and registered within the system. 

Rj It is known that data traffic over a data-packet-network such as 

fn 

3 20 the Internet network typically arrives at processors in a series of data 
ps bursts. This means that the processing workload over time of core 106 

will experience peaks, valleys, and perhaps periods of idleness. These 
periods of low workload and idle times are unavoidable in the current art. 
The goal of the present invention is to utilize low workload and idle 
25 times for speculative data processing on future data packets yet to arrive. 

Fig. 2 is a block-diagram illustrating components of a novel 
network processing system according to an embodiment of the present 
invention. In this example, a packet buffering system 20 1 is provided 
with a capability of predicting characteristics of some data packets before 
30 they arrive to the processing system. System 201 comprises queues 

104a-n as described with reference to Fig. 1 above. Direction logic 102 
and selection logic 105 are also present in this example as is processing 



core 106, and these elements are analogous to the components with the 
same element numbers previously described. 

A novel hardware mechanism labeled herein Packet Predictor 202 
is provided within system 202 and enables prediction of data packet 
characteristics before some packets actually arrive through ingress of the 
processing system. Data packet predictor 202 is a front-end hardware 
implementation that generates speculative packet information for a virtual 
data packet (predicted data packet). A packet prediction may be 
triggered by any one of several events and conditions, such as detection 
of idle processor time. A good time, however, and a trigger used in a 
preferred embodiment is when a real data packet is received by the 
processing system. 

Packet predictor 202 has, in this example, a dedicated memory 
(MEM) 204 provided therein and adapted to store historical data 
regarding real data packets previously processed within the system and 
historical data about successful instances of predicted data packets within 
the system, wherein the speculative processing results associated with a 
predicted packet, backed up by a real packet, were correct enough to 
send the real packet out of the system requiring little or no processing of 
the information associated with the real packet. MEM 202 can be a flash 
type MEM, ROM, RAM, or any other type of usable memory sufficient 
in size to hold at least a historical record covering a pre-defined number 
of data packets. 

In a preferred embodiment, MEM 202 stores a revolving history 
record that is updated periodically, whether or not the processing was 
"real" or "virtual". For example, MEM 202 may store historical data 
covering the last 10 data packets received, and also the practical result of 
the last ten data packets predicted. In other embodiments the history 
record could cover many more, or fewer data packets, both real and 
virtual. In an alternative embodiment of the invention, MEM 202 may be 
implemented externally from predictor 202 or from buffer system 201, or 
even externally from the router without departing from the spirit and 
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scope of the present invention. For example, MEM 204 may be an 
assigned portion of existing memory within the processing system such as 
queue memory or processing core memory. There are many possibilities. 
A buffer logic 205 is provided within packet buffering system 201 
5 and adapted to control queue-state reporting and management of queues 
104a-n similarly to buffer logic 103 described above with reference to 
Fig. L In this example logic 205 is enhanced to manage queue set 104a- 
n according to additional predictive capabilities of the present invention. 
Logically speaking, buffer logic 205 has control connection to a shared 
10 access line of queue set 104a-n as well as a control and communication 
connection to packet predictor 202. Additionally, there are illustrated 
connections between buffer logic 205 and direction logic 102 and 
between buffer logic 205 and processing core 106. The significance of 
these connections is explained in more detail below, 
ip 15 In an embodiment of the present invention, a novel method is 

^J! practiced in conjunction with the capabilities of packet predictor 202 

p wherein all or a defined portion of characteristics of a next data packet to 

f| arrive to the processing system are predicted based upon current 

JjJ historical record accessed from MEM 204. 

Ill 20 Packets In to direction logic 102, or at least information relative 

0 

y, to these packets, is also copied into predictor 202. When a packet 

arrives, predictor 202 generates a prediction of the nature of the next 
packet to arrive based on data in MEM 204. Information predicted can 
include several separable components of a next packet, all of which, or 

25 some of which may be predicted depending on desired configuration. 

For example, header information includes typically some or all of source 
information, destination information, packet flow information, data 
protocol information, packet size information, and media type 
information. Each of these components of information in the header of a 

30 data packet can be regarded as a separate predictable component. 

Moreover, some of these components share dependencies. For example 
a header of two separate packets having a same source and destination 



address arriving in a close time period are quite likely to be of the same 
packet flow. Packets of a same flow are further quite likely to be of a 
same size. Packets of a same flow are also likely to be of a same 
protocol such as UDP or TCP/IP and so on. 

An important object of the invention is to make a total or at least 
a partial prediction for a new (at this point virtual) data packet, not yet 
received, based on consultation of the history record in MEM 204 at the 
time of receipt of a real data packet, or at the instance of some other 
triggering event or condition. Information of the real data packet 
received would comprise the next historical entry in MEM 204. 

In one embodiment, the historical data could be componential 
such that each predictable component category has its own constantly 
changing variable. Each component variable can be probability-based 
and weighed against a preset threshold. In this way, variables with a high 
likelihood of materializing in the next packet could be included in a 
prediction. In another embodiment, an algorithm is run that incorporates 
the sum weight of all of the component variables and produces a single 
predictive variable that is weighed against a preset threshold value for 
initiating or not initiating a total packet prediction. There are many 
devisable schemes. 

Upon generating a prediction, packet predictor 202 sends 
predictive packet information over a control line to direction logic 102 as 
is illustrated logically with a directional arrow labeled Predicted Packet 
Info. Direction logic 102 then enqueues the information, in this example, 
in a sector of queue 104n (cross-hatched) that has been further divided to 
segregate predicted and real information' of a same packet. The predicted 
information is enqueued in a section labeled Predicted Information. 
Later, when (and if) the real packet arrives, it will be enqueued into the 
same sector of queue 104n in a sub-section (reverse cross-hatched) 
labeled Real Information. 

As the predicted information is enqueued, a Packet ID is 
generated by direction logic 102 identifying the packet number and 
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position in queue. It is noted herein that the packet identification is 
assigned only to the predicted packet information, as a real packet has 
not yet arrived. In one example, buffer logic 205 is enhanced with a 
responsibility of validating a prediction based on access of MEM 204 of 
5 predictor 202 after an arbitrary prediction is made. In this embodiment, 
logic provided within buffer logic 205 runs an algorithm comparing the 
predicted information (the only information in queue at this point) with 
the historical variable and a preset threshold variable. The buffer logic 
then decides whether to accept or to invalidate the prediction. 

10 If the prediction is accepted, then notification is made to direction 

logic 102, which passes the assigned Packet ID through selection logic 
105 to processing core 106 with a command to initiate speculative 
processing. It is noted herein that a commitment to processing the 
predicted information is based on a comparison of the predicted 

1 5 information to the current value of the historical data and subject in a 
preferred embodiment to an acceptance or non-acceptance threshold. 
This algorithm can be run either by buffer logic 205, or by packet 
predictor 202 without departing from the spirit and scope of the present 
invention. 

20 In the first case scenario, predictions are attempted for every next 

packet based on the last known history data before update. The buffer 
logic can, however, invalidate a prediction if its comparison with 
historical data detects that the prediction would likely be in error or does 
not meet a pre-set value threshold. In this case the packet predictor 

25 simply duplicates the last successful prediction instead of consulting 
history. 

In the second case scenario, the packet predictor makes a 
prediction for every next packet wherein the predictions are only made as 
a result of consultation with the history in MEM 204, and the predictions 
30 are arbitrarily accepted and never invalidated before the actual packet 
that the prediction is based on arrives. 
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In either event, processor 106 is initiated when it is deemed that a 
prediction passes algorithm and is considered valid. At this time, 
processor 106 is processing information on a data packet that has yet to 
arrive. When the real packet does arrives, it or the information 
associated therewith is directed by direction logic 102 into a sub-divided 
sector containing the predicted information under processing. It is, of 
course, possible that the processing is completed before the packet 
arrives. It is also possible that the processing has just begun or is 
somewhere in process when the real packet arrives. 

The real data packet information or notification thereof is fed into 
predictor 202 when it arrives. This event may (or may not) generate a 
new prediction. In this example, packet predictor 202 compares the real 
packet information with the predicted information to gauge any error in 
the original prediction. It is noted herein that prediction error can be 
totalized or compartmentalized. For example, it may be that a prediction 
of several characteristics can be in error regarding only one of those 
characteristics. In another embodiment, any error in prediction is 
sufficient to invalidate any processing having occurred in regards to the 
predicted information. Preferably, an error detection can be utilized to 
disregard certain aspects of processing, but retain other aspects that were 
correct. 

In the case that the predicted information is totally or sufficiently 
wrong such as to invalidate any processing currently completed or 
underway on the predicted data, a prediction error notification is sent to 
buffer logic 205, which then issues an invalidation notification on the 
packet ID number associated with the predicted information. The 
predicted information is then discarded from queue and a notification 
containing the invalid packet ID is sent to processor 106 from buffer 
logic 205 (dotted line) ordering interruption and termination of any 
processing still underway on the predicted information. In this case, the 
real information is processed normally under a new packet ID number or 
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under the same packet ID number re-issued to the real packet 
information. 

In an example where a prediction is determined to be wrong 
wherein processing has to be re-initiated and completed for the real 
packet, it is noted that a proportional increase in processing latency 
results. Preferably, prediction error is compartmentalized per component 
such that only processing actually performed or being performed in error 
is invalidated. Using the same packet ID then, only the portion of the 
predicted information in error is discarded from queue and the processing 
results of the components that materialize in the real packet are used. 
Newly initiated processing on the components of the real packet that 
were wrongly predicted is initiated using the same packet ID and an 
increase in latency may be avoided. It is noted herein that prediction 
error data can also be included in history record without departing from 
the spirit and scope of the present invention. 

In the case of successful prediction, the predictive processing 
results are used to send the real packet out of queue when it arrives, 
rendering latent processing of the real packet information unnecessary. 
As soon as a real packet is sent out to egress, the history record is 
updated with the associated information. It is noted herein that it is 
possible that a real packet arrives before any processing is actually 
initiated on it's predicted information. In this case, the packet can be 
processed un-speculatively, or in the event of a 100% correct prediction, 
registers already being loaded with predicted data for processing may 
continue un-abated and the speculative processing results known to be 
correct when performed can still be used to send out the real packet. 

Fig 3 is a block-diagram illustrating components of data packet 
prediction mechanism 202 of Fig. 2 in an embodiment of the invention. 
Packet predictor 202 has a packet predictor control mechanism 310 
provided therein that is adapted to manage and control all of the 
functions of the prediction hardware. MEM 204 containing the historical 
record is illustrated within control block 3 1 0. 
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When a prediction is generated, in this example, MEM 204 is 
accessed for history states (can be equated to values) for a plurality of 
components 1-N. As noted, there are no practical limits to a number of 
separate predictable components of a data packet. In this 
5 compartmentalized example, each separate component is equated to a 
predictor component (algorithm), a plurality of which are illustrated in 
Fig. 3 as component predictors 1-N within a processing block 305. It is 
noted herein that in this example, each configured component is 
computed according to a history of that specific component in terms of 
10 likelihood of that specific component materializing correctly in a real 
packet being predicted. 

A packet generator 309 is provided within predictor 202 and 
adapted to construct the speculative packet or packet information 
l8 according to the results received for each separable component. In one 

if! 1 5 embodiment of the invention, certain components and their predictor 
% blocks may be disabled while other ones of these are enabled. Freedom 

P of configuration is assumed in this example. Block 305 accesses updated 

rg history on each selected component and performs a prediction based on 

m 

|y that history, the predicted value incorporated in the packet construction, 

fll 20 Controller 3 10 sends out the completed predicted packet 

Q 

U information, and in some embodiments, a valid packet ED. Alternatively, 

the buffering logic or direction logic may generate the packet ID in which 
case the ID is sent to predictor 202. If after receiving a real packet or 
information thereof, packet predictor 202 determines error in prediction, 
25 then a prediction error is sent out of controller 310. The prediction error 
notification can be specific to predicted component, and this is the case in 
a preferred embodiment of the invention. It is noted herein that, in some 
embodiments, each time a real packet is received, a new prediction 
process is initiated for a virtual packet. In other embodiments prediction 
30 may be triggered by other events and/or conditions. 

In one embodiment of the present invention, predictor 202 may 
be configured to initiate a prediction only during periods of low 
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workload or idle processor time. In this case the conditions for initiating 
a prediction are: when a packet arrives, if workload is below a specified 
threshold value, commit resources to packet prediction; else, don't 
commit resources. 

It will be apparent to one with skill in the art of packet processing 
that predicting packet characteristics is useful for reducing overall 
processor latency in that data packet processing can be initiated before 
data packets actually arrive. For example, in an event where no or few 
packets are in the system, packet processing on predictive data may be 
initiated during such low or idle processor periods. If the prediction 
proves successful, latency is reduced. Other factors that contribute to 
successful prediction include common organization of same-sourced and 
destined packets into a packet flow. Also prevalent, in some cases in a 
network router, are patterned flow alternations wherein a packet from a 
particular packet flow will be received and then a next packet from a next 
flow and so on wherein the flow characteristics related to received 
packets can be predicted to a reasonable certainty. 

By initiating speculative processing on a next packet based on 
predicted attributes, slow and idle periods inherent to data packet 
processors are filled with data processing. A reasonably accurate 
prediction rate will significantly reduce processor latency thereby 
enhancing performance and speed. 

Fig 4 is a block-diagram illustrating reduced processor latency 
through successful packet prediction according to an embodiment of the 
present invention. In this example, there are 2 simple graphics illustrated. 
The first graphic is a line 401 representing a progression of time and 
illustrates the nature of data packet traffic entering a router over time. 
Data packets are represented in this example as X, Y, and Z representing 
three different packet flows. Packets X, Y, and Z are presented in 
bunches or groups intended to illustrate traffic entering a router or 
processor in data bursts typical of the Internet network, for example. 



-15- 



The second graphic illustrated is represented by line 402, which is 
a time line analogous to line 401 . A processor workload is represented 
as a solid line exhibiting certain peaks, valleys, and idle periods (portions 
merging with time line 402). In association of the second graphic to the 
first one, it can bee seen that the peak periods of the processor workload 
over time correspond to the instances of data packets existing for 
processing. At valleys and idle sections of the processor workload line of 
the second graphic it can be seen, relating to the first graphic, that there 
are fewer or no data packets for processing. 

In the first graphic, a processing time A is illustrated as beginning 
at a point along line 401 corresponding with an actual data packet Y 
received for processing. In other words, the processor would begin 
processing the first data packet Y at that point in time. If data packet Y 
illustrated at processing time A could have been successfully predicted 
before it had arrived, speculative processing could have been initiated 
earlier. In the second graphic a processing time B is illustrated as 
beginning on line 402 at the end of the most recent peak processing 
period. The speculative processing of packet Y in this case uses 
otherwise idle processor time and results in a subsequent processing peak 
that occurs before what would have normally occurred. Therefore, 
processor latency is plainly reduced by successful prediction of one of the 
represented packets. 

Successful prediction of subsequent packets further reduces 
latency because at least one prediction is made every time a real packet is 
received. This fact tends to create some processing in otherwise idle and 
slow processor periods. In the last 10 of twelve packets represented in 
Fig. 4, it is noted that a packet from flow Z occurs every 4 packets. A 
next prediction might therefore be made that a next data packet to arrive 
will more than likely be a packet from either flow X or Y since the next 
packet will be the third packet from the last packet of Z. In this case, a 
prediction component represents what is most likely not to occur, which 
may narrow to a more successful prediction of a correct flow. Of course 
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predicting a correct flow implies successful prediction of source and 
destination in the header information and so on. There are many possible 
prediction schemes, some of which depend on existing network 
conditions and rules used by an enabled processor. 

Fig. 5 is a process flow diagram illustrating system steps for 
practicing packet prediction according to one embodiment of the present 
invention. At step 501, after a packet is received, a prediction is made 
regarding a next packet that will arrive in a processing system. Step 501 
is performed, in a preferred embodiment, at each instance of receiving a 
real data packet into the system. At step 502, packet history data is 
updated with the correct information from the latest received packet as 
well as any relevant prediction data that may aid in forming a useful 
history record. The history record can be coded a metadata format or 
other machine-readable protocols. 

At step 503, in this exemplary process, the prediction of step 501 
is accepted or rejected after consulting updated history records. Step 
503 is optional as the prediction at step 501 may be arbitrarily accepted 
as valid until an actual packet arrives. In step 503, if the prediction of 
step 501 is validated, processor resources are committed for speculative 
processing in step 505. If the prediction of step 501 is invalidated, then 
at step 504 the system waits for the real packet to arrive. A reason for 
invalidation may be that the last history update has caused the last 
prediction to be more unlikely and fall in terms of value below a pre-set 
threshold. 

At steps 507 and 506 in both scenarios stemming from step 503, 
the real packet subject to the prediction of step 501 arrives within the 
system. In embodiments wherein the trigger event for predicting a virtual 
packet is the arrival of a real packet, immediately, a next prediction is 
made for a next data packet resolving back to step 501 . In the case that 
the original prediction of step 501 was validated in step 503, at step 508 
the prediction is validated against the real packet data received at step 
507. As previously described, step 503 is optional and its function can be 
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replaced by step 508. Step 508 is more valid because the comparison is 
against real data. 

If at step 508 the prediction stands as valid against the real packet 
data, then at step 509 the real packet predicted is sent out according to 
the results of speculative processing. Else, if the prediction of step 501 
wholly or partially failed against the real packet data, then at step 510, 
speculative processing at least for the wrong components is abandoned. 
Any wrong results already written in error are similarly abandoned at step 
510. However, any results that were predicted correct are kept and 
utilized. In this way the speculative processing is not a total waste, 
unless all predicted components were in error. 

At step 5 1 1, the real packet is processed in the event of a total 
invalidation of the prediction of step 501 . Otherwise, only the portion of 
the data of the real packet that was wrongly predicted will be processed, 
again saving resources where possible. At step 513, the real results and 
any speculative confirmations resulting from steps 511 and 509 are 
updated into the packet history. 

In a history of limited entries, say for example 100 entries, then 
the last entry would drop out of the history at each update. It is 
important to note herein the granularity and entry number (per packet) 
may vary according to design and prediction scheme employed. One 
with skill in the art will appreciate that a larger history will provide more 
accuracy for prediction variables, but using a larger history record could 
take more time for computation. Therefore, a reasonable number of 
packet entries may be relatively small in comparison to total data traffic 
traveling through a router or processing system. 

However, many components that may be predicted will have 
computations that may begin as soon is an update is registered. All of 
the separate component values may be simultaneously calculated. 

At step 513, the history record is updated as a result of sending a 
packet out in steps 509 and immediately after step 511. Step 509 in this 
example is considered a same step for both scenarios stemming from step 
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508 with the only difference being the speculative or un-speculative 
nature of the processing results. 

It will be apparent to one with skill in the art that steps in this 
exemplary process may be re-ordered, eliminated, or supplemented with 
sub-routines without departing from the spirit and scope of the present 
invention. For example, if step 503 as an option is eliminated, then 
speculative processing will always result from all predictions until real 
packet data arrives. This embodiment may be desired if the prediction is 
compartmentalized into several separately predictable and processable 
components. 

At step 501, if making a prediction is based on a consultation of 
history record (step not shown), then it is possible periodically that a 
prediction will not be made, and step 501 will resolve to step 504 for the 
instant packet in question. 

It will be apparent to one with skill in the art that even a small 
success rate of packet prediction can increase processor efficiency. The 
system, apparatus, and method of the present invention can be utilized in 
any machine capable of forwarding data packets through a network from 
source to destination. Therefore the claimed subject matter below should 
be afforded the broadest of interpretation. The spirit and scope of the 
present invention is limited only by the claims that follow. 



